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Recent developments in the interfacing of neurons with silicon chips may 
pave the way for progress in constructing scalable neurocomputers. The as- 
sembly of synthetic neuronal networks with predefined synaptic connections 
and controlled geometric structure has been realized experimentally within the 
last decade. Furthermore, when such neuronal networks are interfaced with 
semiconductors, action potentials in neurons of the network can be elicited 
by capacitative stimulators, and voltage measurements can be made by tran- 
sistors incorporated into the associated silicon chip. Despite the impressive 
progress, such preliminary devices have not yet demonstrated the performance 
of useful computations, and constructing larger devices can be both expensive 
and time-consuming. Accordingly, an appropriate modeling framework with 
the capability to simulate current experimental results in such devices may 
be used to make useful predictions regarding their potential computational 
power. A proposed modeling framework for functional neuronal networks 
interfaced with silicon chips is presented below. 
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1 Introduction 



There are two motives that are currently driving the desire to construct a neu- 
rocomputer. Firstly, attempting to discover the mechanisms by which vertebrate 
brains demonstrate intelligence is extremely difficult when studying such structures 
in vivo, due to their enormous complexity and due to our shortage in non-invasive 
procedures for probing such systems with single-cell resolution p]. Although cultured 
reconstructions of neuronal networks have provided us with more optimism, such as- 
semblies remain structurally complex, and their synaptic wiring remains unclear [2]. 
The construction of simple neuronal networks with predefined synaptic wiring will 
improve studies on the functionality of such systems. 

Secondly, conventional computers are reaching their limits. The search for a 
more powerful computational paradigm has lasted for more than a decade, and 
the physical realization of a scalable quantum computer has been proven to be 
exceptionally challenging [3J. A technology capable of exploiting neurons to perform 
computations may address this problem, since it is well-recognized that neurons 
have incredible potential. 

Recent developments have been made towards the construction of neurocomput- 
crs [25j[2j; however, these constructions are still very simple, and it can be expensive 
and time-consuming to construct synthetic neuronal networks that are adequately 
large to perform interesting computations. The primary objective of this study is 
to develop a mathematical model that describes the neurodynamics in existing at- 
tempts to implement synthetic neuronal networks with functionality. Once such a 
mathematical model is able to reproduce experimental observations in the existing 
simple synthetic neuronal networks (such as voltage readings of action potentials), 
the model can then extrapolate to predict the behaviour of more complex networks. 
Consequently, we can perform computational experiments in neurocomputing, and 
this may serve as a step towards the investigation of the practicality of such com- 
putational devices. 

2 Review of Literature 

2.1 Neuronal Networks in Culture 

2.1.1 Historical Notes 

Some of the simplest nervous systems present in the animal kingdom are those 
of the phyla Cnidariajl] and Echinodermata. Such systems (which are called "nerve 
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nets") may be relatively easy to study, but are not capable of many of the higher- 
order functions in which theoretical neuroscientists are often interested. Adding 
to the challenge, invertebrate nervous systems capable of executing such functions 
are often too complex to study as a whole, and accordingly, methods have been 
developed to reconstruct partial circuits of identified neurons in cell cultures. 

Such practice began in 1972 with the isolation of single nerve cells from the 
brains of Lymnaea stagnalis molluscs (freshwater snails) which were then cultivated 
in vitro by Kostenko[5|. A few years later, in 1979, a group of researchers at the 
California Institute of Technology described neuronal networks of the marine snail 
Aplysia calif ornica in cell culture [BJ. Such work soon became more customary and 
was adopted by a great deal of neuroscientists in the early 1980s[7-ll]. 

2.1.2 Significant Progressive Developments 

In 1990, a study involving the in vitro reconstruction of the respiratory central 
pattern generator in Lymnaea stagnalis made a discovery regarding the mechanism 
of its function that would not otherwise have been made if the system was not 
studied in cell culture [12]. Based on previous studies of the intact nervous system, 
it was suspected that the generation of the respiratory rhythm driving expiratory 
and inspiratory lung movements in the snail was enforced by some subset of three 
particular neurons (but which combination of these three were actually required, 
and whether or not more neurons were required still remained a mystery). These 
three cells were then isolated and grown in cell culture. It was discovered that the 
appropriate rhythmic activity was not evoked in any of the individual neurons when 
isolated. Likewise, no two pairs of these neurons elicited the necessary activity, but 
when all three of the neurons were interconnected, the system exhibited a rhythmic 
output identical to the activity observed in the intact nervous system. In this 
fashion, studying a reconstructed neuronal network in vitro lead to a discovery that 
one was not able to conclude at the time, based on studies of the entire intact 
nervous system. 

2.1.3 Remaining Challenges 

As incredible as the above discovery was, more complicated neurobiological 
functions involving larger and much more tortuous networks of neurons may be im- 
practical to study using this technique, since the synaptic wiring often still remains 
unclear in cell cultures. This lead to the development of neuronal networks in which 
we have predefined the synaptic wiring. 
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2.2 Neuronal Networks with Predefined Topology 



2.2.1 Historical Notes 

Guided outgrowth of neurites has been accomplished by several research groups 
since 1985 [13-19], but the formation of synapses under explicit control was not 
realized until more recently. 

2.2.2 Significant Progressive Developments 

In January of 2000, Astrid Prinz and Peter Fromherz of the Max Planck Insti- 
tute for Biochemistry implemented and reported a procedure for controlling synapse 
formation by guided outgrowth of neurites in neurons from Lymnaea stagnalis. 

On the culture dish, proteinaceous conditioning factors obtained from the snail's 
brain were adsorbed to a substrate coated with polylysine. The conditioning factors 
were then locally inactivated in particular regions by ultraviolet illumination, which 
resulted in defined geometric patterns of conditioning factors which would eventu- 
ally act as guides for the outgrowth of the neurites. These patterns were manifested 
in the form of linear strips 14/xm in width. Pairs of Lymnaea neurons were then 
placed at opposite ends along these strips and separated by several hundred mi- 
crometers. Over time, neurites would grow from these neurons, following the strips 
of conditioning factors, and synaptogenesis would occur as the growth cones of the 
two neurons collided (as displayed in Fig.l). 




Figure 1: Guided encounter of the growth cones of two neurons from Lymnaea 
stagnalis. The width of the linear trace of proteinaceous conditioning factors is 
14/xm. This figure was reproduced with the kind permission of the publisher and 
authors of Ref. |25|. 
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Action potentials in a presynaptic neuron were induced by injecting a depolar- 
izing current, and this lead to action potentials in the corresponding postsynaptic 
neuron in cases where there was strong enough coupling between the two neurons. 
This method can then be extended to formulate networks of neurons with higher 
populations and with more connections. 

2.2.3 Remaining Challenges 

A crucial shortcoming of guiding the growth of neurites in this manner emerges 
from the fact that the neurons often cannot maintain their adhesion to the sur- 
faces for extended culture times [T9(, [20] . Additionally, one needs a reliable method 
to stimulate particular neurons, and to measure the responses of members of the 
network at the single-cell level. Both of these shortcomings can be addressed by 
neuronal networks interfaced with silicon ships. 

2.3 Interfacing Neurons with Silicon Chips 

An alternative to directing the growth of neurites by chemical tracks on a 
culture dish involves crafting pre-defined topographical structures on the surface of 
silicon chips. Such topographical structures include circular pits connected by 14/im 
wide grooves (as displayed in Fig. 2a). 




(a) Circular pit and grooves on silicon surface (b) Neuronal network interfaced with the chip 



Figure 2: A silicon chip interfaced with a topographically controlled network of 
neurons. This figure was reproduced with the kind permission of the publisher and 
authors of Ref. 0. Copyright Wiley- VCH Verlag GmbH & Co. KGaA. 

Additionally, the bottom of each pit contains a capacitative stimulator for in- 
ducing depolarizations (and desirably, action potentials), and a transistor used to 
probe the responses of the neurons. These microstructures are not visible in Fig.2. 
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As in the case of the pairs of interconnected neurons whose neurites were guided 
by chemical tracts, stimulations made using the capacitative stimulator are able to 
induce action potentials in individual neurons, which are often able to elicit action 
potentials in a proceeding neuron. 

Such experiments provide a fresh feel of optimism towards the construction of 
synthetic neuronal networks with functionality, which will be a central step in the 
journey towards building a scalable neurocomputer. However, no mathematical 
modeling of the electrodynamics associated with such constructions has been pub- 
lished thus far. The following chapter describes how I propose to model this system, 
and how I anticipate to utilize the model to describe the reported experimental 
results, as well as to make valuable predictions for future experiments in neurocom- 
puting. 

3 Computational Modeling 

3.1 Electrophysiological Modeling 

The first task to confront is to distinguish an appropriate modeling framework 
for the electrophysiological properties of the particular neurons which I am consid- 
ering in this work: Lymnaea stagnalis. 

3.1.1 The Moris-Lecar Model 

To begin with, let us consider the Morris-Lecar (ML) model[2T] for generating action 
potentials in single-cells: 



= ~ gcam^V^V -V Ca ) - g K w(V -V K ) - g L (V -V L ) + I app (1) 



dw Woo(V) — w 



(2) 



dt ' t(V) 



where 
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A complete list describing the identities of the above symbols used is provided in 
the appendix. This model is able to provide a reasonable description of the voltage- 
dynamics associated with action potentials in neurons in vivo. Particularly, it uses 
an instantaneously responding voltage-sensitive Ca +2 conductance for excitation and 
a delayed voltage-dependent K + conductance for recovery [22J. For this reason, it will 
be necessary to modify this model to account for the fact that the action potentials 
in the neurons of these synthetic networks are induced electrically by capacitative 
stimulators, rather than by fluctuations in the chemical concentrations of certain 
ionic species. 

3.1.2 The Leaky-Integrate and Fire (LIF) Neuron Model 

An alternative model with which to begin this analysis is the Leaky-Integrate 
and Fire (LIF) Neuron model. Since the activity of the neurons in the synthetic net- 
work is not likely to be very similar to the electrodynamics associated with neurons 
in vivo, the LIF Neuron model may be a more appropriate starting point for this 
analysis. This is because the mathematical expressions used in this model were not 
derived based on the physiology of particular neurons, but instead were derived in 
terms of general circuit elements (unlike the Morris-Lecar model which was derived 
specifically in terms of Ca +2 and K + conductances). This provides the LIF Neu- 
ron model with some flexibility in order to account for the fact that the electrical 
stimulation of these neurons is purely artificial. This model can be expressed as 
follows: 



a>i(x) 



Gi[Ji(x)] 



(6) 




otherwise 



, | ^jbias ^ ^"threshold 



(7) 




(8) 



where spikes occur when a>iX + J\ f ias > jt hreshold ; an d are approximated as infinites- 
imally small intervals of infinite voltage (i.e. Dirac-Delta functions). 
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Accordingly, the spike train can be represented with respect to time as a sum of 
Dirac-Delta functions, each representing the occurrence of a spike at time t n : 



Once again a complete list describing the identities of the above symbols is 
provided in the appendix. 

In either the case of the LIF Neuron model or the ML model, we must tailor 
the model to characterize the Lymnaea stagnalis particularly - which will involve 
experimenting with the free parameters in the model in order to synchronize the vir- 
tual behaviour with the results presented in [2]. A comprehensive model of Aplysia 
neurons reported in Ref. [23] should provide a good starting point for investigating 
the Lymnaea neurons (no reports with such detailed models have been found for 
Lymnaea yet). 

3.1.3 Extentions of the ML and LIF models 

To complement the above preliminary models, we must add at least two more 
degrees of sophistication - we must modify these preliminary models (which only 
consider ion flow from the soma of one neuron to the soma of another neuron) to 
absorb the fact that the ion flow considered here occurs between neurites rather than 
cell bodies, and we must determine whether or not it is necessary to incorporate 
spatial dependence in the system of differential equations (DEs). To address spatial 
dependence, we can start with the partial differential equation of cable theory for 
dendritic neurons [23]: 



and examine how dependent the steady-state voltage value is on small perturbations 
in the position values. This will provide some insight with regards to whether or 
not it is necessary to add spatial dependence in the model. 

In lieu of this partial differential equation, incorporating an explicit time-delay 
in our model may be sufficient (although this time-delay may need to be a function 
of the length of a particular neurite, in the case where many of the neurites in the 
network are of different lengths). 



n 




(9) 
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3.2 Predictions Sz. Comparisons with Physical Realizations 

Once an appropriate modeling framework has been identified, we can test its 
performance for the simplest possible network: a pair of interconnected neurons. 
The results of the simulation will then be compared with the results presented in 
Fig. 3 and modified according to how well the results match, until we are satisfied 
with the model. This stage of the analysis may involve adding noise terms to the 
system of DEs in order to account for the ubiquitous effects of the environment. 



Figure 3: Experimental results for a simple synthetic network of two mutually 
synapsing neurons stimulated by capacitative stimulators. This figure was repro- 
duced with the kind permission of the publisher and authors of Ref . [2] . Copyright 
Wiley- VCH Verlag GmbH & Co. KGaA. 

Subsequently, the model will be tested against the results provided for a network 
of four interconnected neurons: Fig. 4. The simulation should also be able to predict 
reasonable values (between 0.02 and 0.80) [25J for the coupling coefficients that the 
experiments were unable to determine (the dotted lines shown in Fig. 4a). 

Once this model is able to successfully reproduce the experimental results for the 
two-neuron and four-neuron systems, I will attempt to apply the model to a much 
larger (virtual) network of neurons - one capable of performing useful computations 
such as addition of scalar signals or a neural integrator |26j. 

Theoretically, we should be able to predict the electrophysiological response in 
a neuron at the end of a chain, based on a known stimulus to a neuron at the 
beginning of the chain, and the results of such simulations will provide us with insight 
regarding the mechanisms by which we can manipulate these networks to perform 
computations. We will then be ready to numerically simulate neurocomputational 
experiments, and attempt to implement simple logical operations such as AND 
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gates, NOT gates, FANOUT gates, and combinations of the above. 

Since all computations (according to the Church- Turing thesis) can be performed 
as a combination of the above logic gates, the simulations made here will demon- 
strate that synthetic neuronal networks do in fact have the potential to form the 
basis of a scalable biological computing device. 




1 ni»Tia HJD11& 1 actus. 



Figure 4: Experimental results for a simple synthetic network of four mutually 
synapsing neurons stimulated by capacitative stimulators. This figure was repro- 
duced with the kind permission of the publisher and authors of Ref . [2J . Copyright 
Wiley- VCH Verlag GmbH & Co. KGaA. 
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A Appendix 



A.l Morris-Lecar Model Symbol Identifications 

C = Membrane Capacitance 

V = Membrane Potential 
g Ca = Ca +2 ion conductance 

V Ca = Nernst Potential for calcium ions 

gk = K + ion conductance 

Vk = Nernst Potential for potassium ions 

ql = Conductance for a leak of ions 

Vl = Nernst Potential for the leak of ions 

I app = Applied current 

r = Time constant for action potential 

w = Recovery variable 

= Time constant for recovery process 

Vi = Free variables (fitted to different systems of interest) 

A. 2 Leaky-Integrate and Fire Neuron Model Symbol Iden- 
tifications 

a = Firing rate of neuron 

G = A non-linear function of the input current 

J = Input current 

r ref _ R e f rac t or y period 

t rc _ Characteristic time 

jthreshoid _ Threshold current (current required for firing) 

jbms _ N j se term to represent the current from the environment 

V = Membrane potential 

Jm = Current through membrane 

R = Resistance of membrane 

C = Capacitance of membrane 

t = Time 

x = Analog signal 

a = Gain factor 
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A. 3 The Partial Differential 

A = Characteristic length 
r = Characteristic time 
V = Membrane potential 
x = Spatial coordinate 
t = Time coordinate 



Equation of Cable Theory 
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